Examining Differences in Examinee Performance in Paper and Pencil and Computerized Testing
نویسندگان
چکیده
The study evaluated the comparability of two versions of a certification test: a paperand-pencil test (PPT) and computer-based test (CBT). An effect size measure known as Cohen’s d and differential item functioning (DIF) analyses were used as measures of comparability at the test and item levels, respectively. Results indicated that the effect sizes were small (d < 0.20) and not statistically significant (p > 0.05), suggesting no substantial difference between the two test versions. Moreover, DIF analysis revealed that reading and mathematics items were comparable for both versions. However, three writing items were flagged for DIF. Substantive reviews failed to identify format differences that could explain the performance differences, so the causes of DIF could not be identified. Examining Differences in Examinee Performance in Paper and Pencil and Computerized Testing Gautam Puhan Keith Boughton Sooyeon Kim Educational Testing Service, Princeton, New Jersey
منابع مشابه
The Influence of Examinee Test-Taking Motivation in Computerized Adaptive Testing
The purpose of the study was to investigate the effects of test motivation on estimated ability, test anxiety, and attitudes toward computerized adaptive testing (CAT). Korean college students (n=208) were given the Math Aptitude Test, Math Self-Concept Scale, Math Test Anxiety Scale, Computer Competence Instrument, Computer Anxiety Scale, and Test Anxiety Inventory in the regular classroom. Th...
متن کاملSocial desirability and controllability in computerized and paper-and-pencil personality questionnaires
The main objective of this study was to examine Steel's [Advances in Experimental Social Psychology 21 (1988) 261] self-affirmation theory, by checking the effects of different levels of manipulated control on participants' performance on personality tests. Specifically, we assessed the impact of participants' level of control (i.e. prior familiarity of questionnaire's items, choosing of test c...
متن کاملAcademic Testing Item Response Theory Approach
CTT is best suited for traditional testing situations, either in group or individual settings, in which all the members of a target population, e.g., persons seeking college admission, are administered the same or parallel sets of test items. These item sets can be presented to the examinee in either a paper-and-pencil or a computer format. Regardless of format, it is important for the measurem...
متن کاملEvaluating Computerized Adaptive Testing Systems
Many educational organizations are trying to reduce the cost of exams, the workload, delay of scoring, and the human errors. Also, organizations try to increase the accuracy and efficiency of the testing. Recently, most examination organizations use Computerized Adaptive Testing (CAT) as the method for large scale testing. This chapter investigates the current state of CAT systems and identifie...
متن کاملMeasures of Partial Knowledge and Unexpected Responses in Multiple-Choice Tests
This study investigates differences in the partial scoring performance of examinees in elimination testing and conventional dichotomous scoring of multiple-choice tests implemented on a computer-based system. Elimination testing that uses the same set of multiple-choice items rewards examinees with partial knowledge over those who are simply guessing. This study provides a computer-based test a...
متن کامل